Search Results for "ai inference"
Alibaba Unveils Its First Home-Grown AI Chip
Chinese e-commerce giant Alibaba unveiled its first artificial intelligence inference chip on Wednesday, a move which could further invigorate its already rip-roaring cloud computing business.
Enhancing AI Inference with NVIDIA NIM and Google Kubernetes Engine
NVIDIA collaborates with Google Cloud to integrate NVIDIA NIM with Google Kubernetes Engine, offering scalable AI inference solutions through Google Cloud Marketplace.
NVIDIA's TensorRT-LLM Multiblock Attention Enhances AI Inference on HGX H200
NVIDIA's TensorRT-LLM introduces multiblock attention, significantly boosting AI inference throughput by up to 3.5x on the HGX H200, tackling challenges of long-sequence lengths.
AWS Expands NVIDIA NIM Microservices for Enhanced AI Inference
AWS and NVIDIA enhance AI inference capabilities by expanding NIM microservices across AWS platforms, boosting efficiency and reducing latency for generative AI applications.
NVIDIA Enhances AI Inference with Full-Stack Solutions
NVIDIA introduces full-stack solutions to optimize AI inference, enhancing performance, scalability, and efficiency with innovations like the Triton Inference Server and TensorRT-LLM.
NVIDIA Unveils GeForce NOW for Enhanced Game AI and Developer Access
NVIDIA's GeForce NOW expands its cloud gaming service, offering new AI tools for developers and seamless game preview experiences, broadening access for gamers globally.
NVIDIA Dynamo Enhances Large-Scale AI Inference with llm-d Community
NVIDIA collaborates with the llm-d community to enhance open-source AI inference capabilities, leveraging its Dynamo platform for improved large-scale distributed inference.
NVIDIA Unveils TensorRT for RTX: Enhanced AI Inference on Windows 11
NVIDIA introduces TensorRT for RTX, an optimized AI inference library for Windows 11, enhancing AI experiences across creativity, gaming, and productivity apps.
Optimizing LLM Inference with TensorRT: A Comprehensive Guide
Explore how TensorRT-LLM enhances large language model inference by optimizing performance through benchmarking and tuning, offering developers a robust toolset for efficient deployment.
NVIDIA Dynamo Expands AWS Support for Enhanced AI Inference Efficiency
NVIDIA Dynamo now supports AWS services, offering developers enhanced efficiency for large-scale AI inference. The integration promises performance improvements and cost savings.
NVIDIA Unveils NVFP4 for Enhanced Low-Precision AI Inference
NVIDIA introduces NVFP4, a new 4-bit floating-point format under the Blackwell architecture, aiming to optimize AI inference with improved accuracy and efficiency.
Enhancing AI Model Efficiency: Torch-TensorRT Speeds Up PyTorch Inference
Discover how Torch-TensorRT optimizes PyTorch models for NVIDIA GPUs, doubling inference speed for diffusion models with minimal code changes.